The power metric: a new statistically robust enrichment-type metric for virtual screening applications with early recovery capability
نویسندگان
چکیده
A new metric for the evaluation of model performance in the field of virtual screening and quantitative structure– activity relationship applications is described. This metric has been termed the power metric and is defined as the fraction of the true positive rate divided by the sum of the true positive and false positive rates, for a given cutoff threshold. The performance of this metric is compared with alternative metrics such as the enrichment factor, the relative enrichment factor, the receiver operating curve enrichment factor, the correct classification rate, Matthews correlation coefficient and Cohen’s kappa coefficient. The performance of this new metric is found to be quite robust with respect to variations in the applied cutoff threshold and ratio of the number of active compounds to the total number of compounds, and at the same time being sensitive to variations in model quality. It possesses the correct characteristics for its application in early‐recognition virtual screening problems.
منابع مشابه
Comment on “The power metric: a new statistically robust enrichment-type metric for virtual screening applications with early recovery capability”
A new metric for the evaluation of model performance in the field of virtual screening and quantitative structure-activity relationship applications is described. This metric has been termed the power metric and is defined as the fraction of the true positive rate divided by the sum of the true positive and false positive rates, for a given cutoff threshold. The performance of this metric is co...
متن کاملReply to the comment made by Šicho, Vorśilák and Svozil on ‘The Power metric: a new statistically robust enrichment-type metric for virtual screening applications with early recovery capability’
© The Author(s) 2018. This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if c...
متن کاملDefinition of General Operator Space and The s-gap Metric for Measuring Robust Stability of Control Systems with Nonlinear Dynamics
In the recent decades, metrics have been introduced as mathematical tools to determine the robust stability of the closed loop control systems. However, the metrics drawback is their limited applications in the closed loop control systems with nonlinear dynamics. As a solution in the literature, applying the metric theories to the linearized models is suggested. In this paper, we show that usin...
متن کاملFRED Pose Prediction and Virtual Screening Accuracy
Results of a previous docking study are reanalyzed and extended to include results from the docking program FRED and a detailed statistical analysis of both structure reproduction and virtual screening results. FRED is run both in a traditional docking mode and in a hybrid mode that makes use of the structure of a bound ligand in addition to the protein structure to screen molecules. This analy...
متن کاملAn Effective Approach for Robust Metric Learning in the Presence of Label Noise
Many algorithms in machine learning, pattern recognition, and data mining are based on a similarity/distance measure. For example, the kNN classifier and clustering algorithms such as k-means require a similarity/distance function. Also, in Content-Based Information Retrieval (CBIR) systems, we need to rank the retrieved objects based on the similarity to the query. As generic measures such as ...
متن کامل